Skip to main content
Version: 3.1 (latest)

Publishing a Dataset for Compute-to-Data

A data provider can publish a dataset with compute access type when the collection of data cannot be downloaded as-is. This type of data needs to be computed with a trusted algorithm job to produce a distributable output file.

To publish a dataset for compute-to-data purposes:

  1. Log in to the marketplace.
  2. From the left navigation bar, go to Create > Dataset.

Step 1: Connect Your Asset

  1. Set your access type as 'Compute'.

  2. Select 'Disable' for the Aggregate Only setting.

  3. Select the Edge Node that will connect to the data source.

  4. Paste the Source URL of the dataset.

  5. Optional: Add key-value pairs of HTTP headers in your API by clicking 'Add HTTP Headers'.

  6. Optional: Create parameters for your API to allow for more specific data to be fetched from your dataset by clicking 'Add Parameters'.

    To indicate these parameters, fill in the following fields:

    • Display Name: The simplified name of the actual parameter key for, easy understanding by consumers of your dataset.
    • Parameter Key: Actual name of the parameter of your dataset.
    • Parameter Type: The type of parameter input for data consumers (string/int/boolean/options).
    • You may also click on 'Expand' to include a short description of your given parameters.

Step 2: Basic Information

  1. If your data asset does NOT contain real data, select 'Experimental'. Otherwise, select 'Production'.
  2. Name your data asset by providing a concise Dataset Title that will capture the initial attention of potential data consumers.
  3. Categorize your data asset according to the closest industry Category.
  4. Provide an Overview of your asset as a summary.
  5. Provide Additional Details, or any additional information that you think will be helpful to potential data consumers, e.g., data attributes, purpose, etc.
  6. Select the Compatible Algorithm(s) to run with your dataset. You may also choose to skip during publish and add it at a later point. Note that data consumers will not be able to purchase your dataset unless a compatible algorithm has been configured.
  7. Select the Validity Period – how long your data asset should be available to the data buyer after purchase.

Step 3: Further Details

  1. Indicate the Asset Permissions - whether to initially 'Allow All Users' or 'Deny All Users' from consuming your data asset.
  2. Optional: Tag your assets with related keywords to make them searchable to a wider audience.
  3. Optional: Upload or link a Sample File that can be downloaded by data consumers before purchasing your actual data.
  4. Optional: Upload a Sample Image file or screenshot of your asset.
  5. Optional: Link your End User License Agreement to specify any terms and conditions for the use of your data asset.

Step 4: Pricing

  1. Select the pricing type: 'Free', or 'Post-pay'. You will not be able to switch between the pricing types after you have published the asset; however, you can still adjust the actual price if 'Post-pay' pricing is selected.
  2. For Free Pricing, simply click 'Next' to proceed to the next steps. For Post-pay payment, select whether the charging mechanism is 'Set price' or 'Pay-per-byte' and indicate the value.

Step 5: Review and Publish

  1. Review all information. If any updates are needed, click 'Edit' to return to the previous pages or click the 'Go Back' button.
  2. Once finalized, click 'Publish Asset'.